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20.  Abstract  (cont) 

related  entitles,  and  the  underlying  properties  thereof,  are  developed  in  a 
manner  that  such  tradeoff  studies  are  possible. 

The  theoretical  development  as  presented  is  related  to  that  of  statistical 
game  theory  but  with  a broader  set  of  objectives.  Multiple  aspects  for  the 
state  of  nature,  and  sets  of  permissible  action  are  allowed,  with  these  action 
being  capable  of  simultaneous  performance.  This  leads  to  the  introduction  of 
multiple  stat?  multiple  action  decision  theory  and  its  basic  framework,  the 
"mixing  structure." 

The  concept  of  "sensor  mixes"  is  defined  and  related  to  the  possibility  of 
decreasing  loss  by  the  spying  on  the  state  of  nature.  The  cost  of  obtaining 
this  information  is  then  balanced  against  the  gain  obtained  by  knowledge  of 
the  natural  state.  A resulting  "figure  of  merit"  may  be  used  to  determine 
the  desirability  of  each  sensor  mix. 

Several  classes  of  decision  functions  are  defined  which  demonstrate  the 
properties  a decision  function  must  possess  to  be  considered  as  desirable. 

An  illustrative  example  for  the  structures  defined  in  this  thesis  is  then 
presented. 
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CHAPTER  I 
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INTRODUCTION 

The  basis  for  this  thesis  is  the  establishment  of  a mathematical 
framework  of  sufficient  generality  to  perform  cost  versus  operational 
effectiveness  analyses  for  a class  of  physical  problems.  All  involve 
the  obtaining  of  information  concerning  an  evolving  "state  of 
nature".  It  is  desired  in  these  problems  to  determine  an  optimal,  or 
at  least  near  optimal  course  of  action,  when  the  outcome  of  any 
permissible  course  of  action  is  known  to  be  influenced  by  the  "state 
of  nature".  In  this  context,  the  advantages  of  knowledge  of  the 
natural  state  can  be  weighed  against  the  "cost"  associated  with  its 
acquisition. 

This  particular  type  of  problem  occurs  frequently  in  both 
industrial  and  military  applications.  For  instance,  in  the  design  of 
a system,  it  is  desirable  to  assess  the  relative  merits  of  the 
different  possible  configurations  in  terms  of  potential  gain  versus 
anticipated  costs;  i.e.,  to  build  a cost  effective  system.  In 
developing  a meteorological  support  system  for  a military  applica- 
tion, it  is  possible  to  employ  a wide  range  of  meteorological  sensors 
with  varying  degrees  of  accuracies  and  costs.  A commander  who  has 
knowledge  of  this  meteorological  information  may  obtain  an  advantage 
over  his  adversary  by  more  accurately  employing  his  weapons  and  by 
more  strategically  positioning  his  men.  It  is  desirable  in  this  case 
to  determine  that  combination  of  sensors  which  will  yield  maximal 
advantage  for  minimal  expenditure. 

For  nonmilitary  applications  both  cost  and  effectiveness  are 
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usually  expressed  in  a monetary  standard.  However  in  military  appli- 
cations, other  criteria  such  as  loss  of  manpower,  material,  etc.,  may 
also  be  used. 

In  many  practical  applications  both  the  simultaneous  performance 
of  a set  of  actions  and  an  evolving  state  of  nature  must  be  con- 
sidered. Neither  of  these  characteristics  was  found  to  be  of  suffi- 
cient generality  in  the  literature  to  examin.  the  problem  of  interest. 
Thus  it  was  deemed  necessary  to  consider  a new  approach. 

The  general  flow  of  the  presentation  will  be  seen  to  be  remini- 
scent. of  Blackwell  and  Girschick's  classical  work  [2]  on  statistical 
games,  but  altered  considerably  to  meet  the  criteria  established  in 
the  previous  paragraphs. 

Other  theories  exist  which  are  related  to  this  general  problem. 
Statistical  team  decision  theory  [12]  is  the  study  in  which  "several 
persons  perform  various  tasks,  including  those  of  gathering  and 
communicating  information,  and  making  decisions;  but  they  have  common 
interests  and  beliefs."  This  theory,  including  the  works  of  Radner 
[16]  and  Rudge  [17],  does  not  permit  an  evolving  state  of  nature 
except  under  very  restrictive  conditions.  It  also  assumes  that  the 
alternative  states  of  the  environment  are  finite  with  known  proba- 
bilities. In  this  thesis,  no  assumptions  are  made  regarding  the 
probabilistic  aspects  of  the  state  of  nature.  Team  theory  also 
addresses  the  consequences  of  simultaneous  performance  of  actions, 
but,  in  general,  only  under  static  conditions. 

Several  authors  have  examined  problems  relating  to  the  value  of 
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will  be  a realization  of  a random  variable  whose  nature  is  dependent 
on  the  prevailing  state  of  nature.  The  numerical  "loss"  will  be  the 
sole  indicator  of  the  advantage  or  disadvantage  of  a given  plan  of 
action.  Structurally,  a "loss"  function  is  a bivariate  set  function 
whose  domain  is  the  Cartesian  product  of  natural  states  and  permissi- 
ble plans  of  action,  and  whose  range  is  a set  of  random  variables  of 
finite  mean  and  variance  defined  on  an  appropriate  probability  space. 
This  is  the  single  most  influential  mathematical  entity  to  be  con- 
sidered. In  many  applied  problems  the  loss  function  is  implicit  but 
still  must  maintain  these  properties. 

Any  set  function  which  transforms  a realization  of  a set  of 
sensors,  or  a "sensor  mix"  into  an  admissible  plan  of  action,  will  be 
called  a Multiple  State,  Multiple  Action  (MSMA)  decision  function. 
This  function  affords  a link  between  the  natural  state  and  "loss" 
engendered  by  way  of  the  earlier  mentioned  "loss",  or  MSMA  loss 
function  as  it  is  called  in  the  text. 

Certain  problems,  among  them  the  "sensor  mix"  problem  are  intro- 
duced, and  possible  approaches  to  solutions  are  offered.  To 
accomplish  this,  a basic  structure  that  is  called  a "Mixing 
Structure"  is  defined.  This  constitutes  a fundamental  structure 
which  places  all  the  above-mentioned  entities  in  context. 

Of  interest,  and  reminiscent  of  statistical  games,  is  the 
possibility  of  decreasing  loss  by  "spying"  on  the  state  of  nature,  or 
some  desired  substate  via  a "sensor  mix".  The  "cost"  of  sych  an 
action  is  balanced  with  the  "gain"  possible  through  this  knowledge 
and  a resulting  "figure  of  merit"  may  be  used  to  determine  the 


5 


: 

i 

/ 


I 


desirability  of  each  sensor  mix. 

Since  "loss"  is  itself  subject  to  random  influence,  the 
"consistency  of  gain"  becomes  important  and  is  examined.  It  is 
found  that,  in  general,  only  decision  functions  with  precisely 
defined  properties  are  acceptable  in  context,  and  in  this  case,  as 
accuracy  increases,  the  loss  approaches  that  which  might  be  expected 
when  the  appropriate  subset  of  the  natural  state  is  known.  This  is 
essential  if  cost  and  gain  are  to  be  balanced  for  a given  sensor  mix. 

Chaptei  III  presents  an  illustrative  example  of  the  structures 
previously  defined  and  serves  to  demonstrate  both  existence  and 
structure  by  providing  a simple  but  comprehensive  mixing  structure. 

To  highlight  this  example  further,  a simplified  and  somewhat  naive 
version  of  an  artillery  problem  is  offered. 

In  Chapter  IV  certain  open  problems,  either  contemplated  or 
under  investigation,  are  presented. 

It  is  realized  that  the  bulk  of  this  dissertation  is  given  to 
the  establishment  and  verification  of  a mathematical  structure  of 
sufficient  generality  to  consider  a specific  family  of  applied 
problems.  The  complexity  of  the  problems  which  are  considered  are  of 
such  a Scope  that  a fair  volume  of  material  is  left  undone;  however, 
the  interest  and  importance  of  answering  these  problems  are  id*  to 
justify  this  development.  This  ultimately  should  prove  beneficial  to 
several  fields  of  endeavor. 
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CHAPTER  II 
BASIC  STRUCTURES 


Let  {f  I p e P}  be  an  indexed  set  of  real-valued  functions 
P 

defined  and  bounded  on  a real  interval  T.  This  family  will  repre- 
sent distinct  physical  observables  persisting  throughout  a specified 
interval  T of  time.  For  a fixed  t e T,  the  real  number  fp(t) 
will  be  called  the  state  of  f at  time  t.  The  set  {f  (t)  ! t e T} 


will  be  called  the  evolution  of  f over  T.  The  fact  that  the 

p 

observables  in  {f  I p e P}  are  distinct  assumes  that  no  two  members 
P 

of  this  family  have  the  same  evolution.  Sets  of  the  form 

{f  | p e P}  will  be  of  special  interest.  For  each  t c T,  the  set 


St  = {fp(t)  | p e P} 

will  be  called  the  state  of  nature  at  t. 

Associated  with  each  t e T will  be  a nonempty  set  A^  called 

the  set  of  actions  at  t.  For  each  such  set  of  actions,  a class  of 

A a 

subsets  A^  will  be  assumed  where  any  in  A^  is  called  an 

admissible  plan  of  action  at  t.  Actions  in  B^  will  have  the 

connotation  of  simultaneous  performance;  hence,  if  an  action  "a"  is 

found  in  Bt,  its  negative  counterpart  is  excluded.  The  indexed  set 

{(At>^t)  | t e T}  will  be  called  the  family  of  actions  over  T.  Any 

family  {Bt  | t e T,  c A^.}  will  be  called  an  admissible  course  of 

. . A 

action . It  will  be  assumed  that  sets  in  A^_  possess  the  hereditary 
property  for  any  t in  T. 

In  the  structure  to  follow,  distinction  will  be  made  between 
instantaneous  properties  specific  to  some  fixed  t in  T,  and  pro- 
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perties  relating  to  the  entire  interval  T.  As  an  example,  the  state 


of  nature  at  t is  an  instantaneous  characteristic,  while  the  evolu- 
tion of  f relates  to  the  entire  interval. 

F 

Basic  to  the  structure  is  the  notion  that  any  admissible  plan  of 

i 

action  performed  at  time  t will  result  in  an  outcome  which  is  to  a 
greater  or  lesser  extent  influenced  by  the  prevailing  state  of  nature, 
and  by  random  external  influences.  An  underlying  concept  which  will 
serve  to  bind  together  the  various  component  structures  is  that  in- 
stantaneously, the  outcome  of  vitiating  an  admissible  plan  of  action 
may  be  characterized  by  a single  numerical  value  of  "loss".  More- 
over, the  possibility  exists  of  diminishing  loss  through  the  choice  of 
a plan  of  action  based  on  "a  priori"  knowledge  concerning  the  state  of 
nature.  Also,  the  possibility  will  be  considered  that  knowledge  of 


the  state  of  nature  may  be  neither  complete  nor  exact.  In  fact,  it 
may  be  subject  to  errors  of  a random  nature. 

In  effect,  the  possibility  will  oe  considered  of  "spying"  on  the 
state  of  nature  with  the  purpose  in  mind  of  minimizing  loss.  To  place 
the  notion  of  "spying"  on  a more  precise  and  tractable  ground,  the 
following  structure  is  introduced. 

Let  (R,L,m)  be  the  measure  space  consisting  of  the  real  numbers 
R,  the  class  L of  Lebesque  measurable  subsets  of  R,  and  the 
Lebesque  measure  m.  Let  £1  be  the  set  of  all  stochastic  processes 
on  this  space  which  are  indexed  by  T and  which  have  the  further 
property;  if  {wt  | t e T}  is  in  £1,  there  exists  a state  variable 
fp  whose  evolution  is  exactly  {E(ut)  | t c T},  where  E denotes  the 
expected  value  operator.  The  set  £1  may  be  visualized  as  containing 
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(h  ) ff  ) will  be  called  the  set  of  sensors  of  f . It  now  becomes 
P P 

possible  to  define  one  of  the  basic  mathematical  entities  which 

figures  in  the  following  development. 

DEFINITION  2.1.  Let  {f  | p e P},  SI,  and  all  those  structures 

implicit  in  their  construction  be  as  previously  defined.  A sensor 

mix  in  0 will  be  defined  as  any  finite  subset  of  n which  meets 

* 

each  member  of  the  h -partition  at  no  more  than  a single  point.  The 

set  of  all  sensor  mixes  in  £1  will  be  denoted  by  r. 

In  most  practical  applications  the  cardinality  of  P will  be 

finite,  although  for  what  follows,  the  cardinality  of  P will  be 

considered  to  be  at  most  countable.  The  assumption  that  each  sensor 

* 

mix  contains  no  more  than  a single  element  of  any  member  of  the  h - 

partition  is  not  as  restrictive  as  it  may  at  first  seem.  Concern 

will  be  with  finite  sensor  sets,  hence  within  the  general  scope  and 

interest  of  the  investigations  to  follow,  any  finite  sensor  set 

belonging  to  a single  physical  observable  may  be  replaced  by  a single 

sensor  which  can  provide  probabilistically  equivalent  information. 

* * * 

In  an  unambiguous  fashion,  h , gg,  and  j define  maps  from  r 
into  {f  | p e P),  R,  and  P respectively,  where  s is  in  T. 

From  this  point  on  these  maps  will  be  denoted  by  h,  gs>  and  j 
respectively. 

THEOREM  2.2.  If  V is  the  class  of  sensor  mixes  as  previously 

defined,  the  following  behavior  traits  are  exhibited: 

a)  For  any  Q c P,  if  {y^  | q e Q}  is  a family  of  sensor 

mixes,  then  n y is  a sensor  mix. 

qeQ  q 
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b)  If  p,y  e T,  and  h(p)  n h(y)  = 4>>  then  p u y e T. 

c)  If  p,y  e r and  h(p)  n h C y)  t <f>.  then  p u y e r if  and 

only  if  f e h(p)  n h(Y)  implies  that 

h_1(fp)  n p = h"1 (fp)  n y- 

d)  If  p, y e r,  then  p - y and  y - p are  in  T.  Thus  the 
symmetric  difference  y ° P is  in  r. 

Proof:  The  proof  is  elementary  and  will  be  omitted. 

Part  c)  of  this  theorem  states  that  if  two  sensor  mixes  are  such 
r’*at  their  images  under  h contain  a common  physical  observable, 
then  the  two  sensor  mixes  must  coincide  at  that  physical  observable 
if  their  union  is  to  be  a sensor  mix. 

A sensor  mix  as  previously  defined  will  serve  as  the  basic  unit 
of  estimation  whenever  "a  priori"  information  is  desired  concerning 
the  state  of  nature. 


At  this  point  the  problem  of  a suitable  space  for  the  realiza- 
tions of  the  various  members  of  r arises.  Toward  this  end,  it  may 
be  noted  that  any  realization  of  a nonempty  sensor  mix  will  be  of  the 


form  {a 

q 


q e Q c P},  where  for  each  q e Q,  a is  a real  number 


and  Q has  finite  cardinality.  Observe  that  without  ambiguity  such 


a vector  may  always  be  identified  with  a function  of  Q into  R.  In 


fact,  the  set  of  realizations  for  a sensor  mix  y may  always  be 


identified  with  the  set  of  real-valued  functions  on  j (y) • This  fact 
is  a motivation  for  the  following. 

A A 

Let  Q be  the  class  of  all  finite  subsets  of  P and  Q e Q. 

Define  X.  = (x  | x : Q + R}  and  let  X = uA  X . The  convention 

4 QeQ  ^ 
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will  be  made  that  <j>  e Q where  <j>  will  be  called  the  empty  sensor 

mix.  Then  X.  will  be  defined  to  be  and  will  by  abuse  of  the 
<p 

language  be  considered  the  "realization*'  of  the  empty  sensor  mix. 

It  is  now  clear  that  any  realization  of  a sensor  mix  y may  be 
identified  with  a unique  member  of  *n  t*le  mater^a^  *° 

this  identification  will  be  assumed,  and  again  by  the  abuse  of  the 
language,  a realization  of  y will  be  spoken  of  as  lying  in  ^ j . 

Adequate  structure  has  been  introduced  to  permit  the  definition 
of  perhaps  the  single  most  influential  mathematical  entity  in  tie 
study  to  follow,  the  multiple  state  multiple  action  (MSMA'1  loss 
function.  This  function  will  serve  to  establish  the  link  between  an 
observation  of  some  subset  of  the  state  of  nature  and  the  outcome  of 


any  course  of  action  which  might  be  taken. 

DEFINITION  2.3.  Let  A be  the  set  of  all  random  variables  on 
(R,L,m)  of  finite  mean  and  variance.  A function  which  carries 

A 

X * A^  into  A will  be  called  an  MSMA  loss  function  at  t.  A 
family  {L^  | t e T}  will  be  called  a progression  of  losses. 

DEFINITION  2.4.  Let  (fp  | p e P},  { (A^ .A^)  | t e T},  n,  X, 

{L^  | t e T},  and  A , along  with  all  structures  inherent  in  their 
composition  be  as  previously  defined.  This  sextuple  of  mathematical 
entities  will  be  designated  as  a mixing  structure  over  T.  It  will 
be  denoted  by  M. 

In  the  next  chapter  it  will  be  demonstrated  that  nontrivial 
mixing  structures  exist  and  a specific  mixing  structure  will  be 
exhibited.  At  present,  existence  will  be  assumed. 

If  a realization  of  a sensor  mix  is  known,  any  function  which 


links  this  realization  with  a plan  of  action  will  play  the  role  of  an 
MSMA  decision  function. 

DEFINITION  2.5.  Let  M be  a mixing  structure  over  T.  Let  6t 

A 

be  any  function  carrying  X into  A^.  Such  a function  will  be 
called  an  MSMA  decision  function  at  t.  A family  {6t  | t e T}  of 
MSMA  decision  functions  will  be  called  a decision  scheme  for  M. 

Note  that  since  4>  e X,  6^(40  must  represent  a plan  of  action 
at  4).  This  plan  of  action  will  correspond  to  a decision  based  on  an 
absence  of  any  knowledge  of  the  state  of  nature.  This  plan  of  action 
6^(40  will  be  called  the  standard  plan  of  action  for  the  MSMA  deci- 
sion function  6^. 

With  this  definition  of  an  MSMA  decision  function,  the  instan- 
taneous operation  of  a mixing  structure  will  now  be  defined.  One 
judiciously  chooses  some  sensor  mix  y e T and  an  MSMA  decision 
function  6^.  At  time  t e T,  the  sensor  mix  y provides  an  esti- 
mate of  the  state  of  nature.  The  decision  function  6^  determines, 
based  on  a realization  of  y,  a plan  of  action  which  is  then  initi- 
ated. This  plan  of  action  permits  an  assessment  of  advantage  through 
a realization  of  the  appropriate  member  of  A.  This  numerical 
indicator  of  loss  determines  the  advantage  or  disadvantage  of  the 
operation  and  completes  an  operational  cycle. 

Observe  that  no  loss  of  time  is  assumed  to  occur  between  the 
determination  of  a realization  of  the  chosen  sensor  mix  and  the 
initiation,  completion,  and  appraisal  of  the  appropriate  plan  of 
action.  If  such  a condition  holds  throughout  T,  the  mixing 
structure  is  said  to  be  a mixing  structure  without  lag.  For  the 
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present,  interest  will  be  with  such  structures. 

In  an  examination  of  mixing  structure  operation,  i':  is  seen  that 
primary  importance  is  placed  on  pairs  of  the  form  (y, {6^  | t e T}); 
i.e.,  pairs  consisting  of  a sensor  mix  and  a decision  scheme.  This 
leads  to  the  following  problems. 

PROBLEM  I:  If  a decision  scheme  is  specified,  the  problem  of 

determining  y (optimal  y)  when  a "cost"  consideration  is  given 
will  be  called  a sensor  mix  (optimal  sensor  mix)  problem. 

PROBLEM  II:  If  y is  given,  the  problem  of  determining 

(6t  | t e T}  will  be  called  an  MSMA  decision  problem. 

PROBLEM  III:  Let  I”  c r be  given,  and  for  each  y'  e I”  , let 
c be  defined  such  that  c is  a real-valued,  nonnegativc  set  function 
defined  on  I”  having  the  property  that  for  p,v  e T'  and  u c v, 
then  c(y)  <_c(v).  c will  be  called  a cost  function  for  r' . If 
(r',c)  is  given  for  some  mixing  structure,  the  determination  of  a 
rationale  for  choosing  a pair  (y,(6t  | t e T >)  will  be  called  a 
fundamental  sensor  mix  problem.  If  constraints  are  included,  the 
problem  will  be  called  a fundamental  sensor  mix  problem  with  con- 
straints . 

The  remainder  of  this  thesis  is  devoted  to  the  development  of  a 
convenient  mathematical  structure  for  the  exploration  of  such 
problems . 

Pertinent  to  the  problems  mentioned  above,  and  to  the  general 
theory  of  sensor  mixes,  is  a special  class  of  functions  in  X.  This 
set  of  functions  is  related  to  the  set  of  states  of  nature  at  a given 
time  t e T,  or  in  other  words,  to  (St  | t e T}.  Define 
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st  : P -*■  R : p -*•  fp(t) . 

It  is  clear  that  for  any  finite  Q c ?•  st |q  s XqI  i-e.,  st  restric- 
ted to  a finite  set  Q is  a member  of  X^  c X. 

Concern  will  be  with  various  finite  subsets  of  St.  By  a slight 
abuse  of  the  language,  an  identification  will  be  made  between  a sub- 
set U of  S^.  and  the  function  st|q  * where 

U = {fq(t)  | q e Q c P}.  Thus  Lt^st  |Q,5t^St  |Q^  wil1  be  written  as 
Lt(U,6t(U)) . No  confusion  should  result  from  this  identification. 

One  basic  characteristic  of  a MSMA  decision  function  may  now  be 
defined. 

DEFINITION  2.6.  An  MSMA  decision  function  6t  is  said  to  be 
consistent  with  the  state  of  nature  if  and  only  if  for  U,V  c 
such  that  U c V it  follows  that 

a)  E[Lt(V,«t(V))]  < E[Lt(U,6t(U))] 

b)  E[Lt(V,6t(V))]  < E[Lt(V,6t(U))] 

c)  E[Lt(U,6t  (*))]  = E[Lt(V,6tU))]. 

The  motivation  behind  Definition  2.6  has  an  intuitive  interpre- 
tation. Condition  a)  states  that  if  an  MSMA  decision  function  6t 
is  consistent  with  the  state  of  nature,  decisions  based  on  an 
increasing  knowledge  of  the  state  of  nature  will  not  result  in  an 
increase  of  expected  loss.  Condition  b)  reflects  the  property  that 
for  any  given  state  of  nature,  one  cannot  decrease  expected  loss  by 
basing  a decision  on  some  smaller  subset.  Finally,  condition  c)  is 
a statement  that  whenever  a decision  is  made  to  use  the  standard  plan 
of  action,  expected  loss  is  independent  of  the  state  of  nature 
observed. 
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properties  of  the  expected  value  of  follow  immediately  from  its 

definition.  Let  U,V  c S^.  with  U c V.  By  definition  of  and 

the  expected  value  operator 

ECGJU)]  = E[Lt(U,6t(*))]  - E[Lt(U,6t(U))]. 

From  Definition  2.6  b) 

ECGt(U)]  < E[Lt(U,6t(*))]  - E[Lt(V,6tCV))]. 

From  Definition  2.6  c) 

ECGt(U)]  < ECLt(V,«t(+))]  - ElLt(V,6t(V))] 

= E[Lt(V,6t(«)  - Lt(V,6t(V))] 

= ECGt(V)]  q.e.d. 

DEFINITION  2.9.  Let  6^.  be  an  MSMA  decision  function  consis- 
tent with  the  state  of  nature.  The  number 

ECG  (V)] 

100  ECGt(St)] 

will  be  called  the  relative  advantage  of  V c S with  respect  to 


It  is  now  possible  to  extend  G (•)  to  y e r.  This  is 
accomplished  by  setting 

Gt(y)  = GtCgt(y)] 

* 

for  all  y e T where  gt(y)  = gt[{w  | u>  e y}]. 

DEFINITION  2.10.  G^fy)  will  be  called  the  gain  of  the  sensor 
mix  The  consistency  of  the  sensor  mix  ^ is  defined  to  be  the 

real  number 


exp(-Var[Gt(y)]) . 

It  should  be  noted  that  the  consistency  of  y lies  in  the 
interval  [0,1].  As  the  variance  of  the  gain  approaches  zero,  the 
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consistency  of  the  sensor  mix  approaches  its  maximum;  whereas,  as  the 
variance  of  the  gain  becomes  large,  the  consistency  of  y approaches 
zero.  This  agrees  with  intuitive  "feel".  It  should  also  be  noted 
that  consistency  is  reminiscent  of  a probability  density. 

THEOREM  2.11.  The  function  Gt  has  the  following  properties  at 
each  t e T: 

a)  ECG  C+D  3 = 0 where  4>  is  the  empty  sensor  mix  in  r. 


b)  If  y,y  e T,  then  ELG^y)]  _<  E[Gt(y)]  when  y c y. 

c)  ECG^Cy)]  >_  0 for  all  y e T.' 

d)  Let  U c S be  given.  If  y,v  e r such  that 
Y,v  e Cgt)  1(U),  then  E[Gt(y)]  = E[G^  (v)]. 

Proof:  The  proof  is  elementary  and  will  be  omitted. 

THEOREM  2.12.  Let  M be  a mixing  structure  and  Gt  be  the 


corresponding  gain  function.  Then 


a)  sup  E[G  (U) ] is  finite  and  achieved  at  U = S . 

UcSt 

b)  sup  E[G  (y)]  exists,  is  finite,  and  is  achieved  for  any 
yeT  Z 

y e (gt)  1(St). 

Proof : 


a)  St  c s , hence  G^. CS^)  e A;  i.e.,  it  has  finite  mean  and 

variance.  From  Theorem  2.7  it  follows  that  E[Gt(*)]  is 

nonnegative  and  monotone  nondecreasing  on  subsets  of  S^.. 

Trivially  it  follows  that 

sup  E[G  (U)]  = E[G  (S  )]. 

UcSt 

b)  Follows  from  a)  and  the  fact  that  all  sensors 
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It  may  be  observed  that  the  concept  of  "gain"  requires  little 


effort  to  extend  it  over  X.  This  is  due  to  the  fact  that  each 
realization  of  a sensor  mix  y e r corresponds  to  some  x e X. 

DEFINITION  2.13.  Let  M be  a mixing  structure  over  T and  let 
6 be  an  MSMA  decision  function.  For  any  x e X define 
Gt(x)  = Lt(x,6tU))  - Lt(x,6t(x)). 

The  random  variable  G^Cx)  will  be  called  the  gain  of  x at  t 
when  the  decision  function  6^  is  employed.  The  consistency  of 
G^fx)  is  defined  to  be  the  real  number 

exp(-Var[Gt(x) ]) . 

An  important  relationship  between  MSMA  decision  functions  and 
the  set  T of  sensor  mix^s  is  contained  in  the  following  definition. 


DEFINITION  2.14. 


a)  Let  U be  a subset  of  the  state  of  nature  S^.. 


An  MSMA 


decision  function  6^  is  said  to  link  the  sensor  mixes  for 
U to  nature  if  and  only  if  the  following  holds.  For  each 
sequence  of  sensor  mixes  {vn  | n = 1,2,*»«}  in  h ^(U) 


such  that 


l Var[z  ]]  ■+•  0 

If.  -\  W \ 


Vj(V 


any  sequence  {x^  ) n = 1,2,«*«}  of  realizations  x^  for 
vn  has  the  property  that 

‘■t<V5t(xn))  * Lt(St|j(vn)-St(St|](vn))) 
in  mean  square  [14]. 


b)  Let  6t  link  the  sensor  m xes  for  U to  nature.  If  for 

all  v e h * (U)  there  exists  a function  w > 0 in  X.,  . 

J(v) 


F 


such  that  for  all  x,y  e ^ satisfying 

I w(q)[y(q)  - s l.f  .(4j]2 
qej(v)  t|nVj 

1 l w(q)[x(q)  - s |.f  .(q)]2, 
qej(v)  t|nVj 

it  follows  that 

ECLt(y,6t(y)) ] £ E[Lt(x,6t(x)) ], 
then  6^  is  said  to  strongly  link  the  sensor  mixes  for  U 
to  nature. 

It  is  intuitive  that  if  an  MSMA  decision  function  links  the 
sensor  mixes  for  U c to  nature,  then  one  would  expect  that  a 

sufficiently  small  value  for  the  variance  of  a given  sensor  mix  would 

in  some  sense  be  accompanied  by  a decrease  in  the  expected  loss  based 
on  this  decision.  The  weight  function  w of  the  strong  link  to 
nature  reflects  that  knowledge  of  the  variables  comprising  the  state 
of  nature  may  not  be  of  equal  importance.  This  is  also  intuitive. 

It  is  important  to  note  the  difference  between  the  concepts  of 
an  MSMA  decision  function  consistent  with  the  state  of  nature  and 

that  of  an  MSMA  decision  function  linking  the  sensor  mixes  for  U to 

nature.  An  MSMA  decision  function  6^  consistent  with  the  state  of 
nature  is  characterized  by  the  fact  that  a decision  based  on  in- 
creased knowledge  of  the  state  of  nature  will  not  result  in  a 
decrease  of  the  expected  gain,  etc.  It  does  not  relate  to  the  degree 
of  gain  which  might  be  expected  as  a realization  if  a given  sensor 
mix  approaches  the  natural  state.  An  MSMA  decision  function  linking 
the  sensor  mixes  for  U c S to  nature  reflects  this  latter  behavior. 
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Both  concepts  will  prove  mutually  beneficial,  and  will  have  consider- 
able importance  in  the  discussions  to  follow.  It  will  be  shown  in 
the  next  chapter  that,  in  general,  these  two  concepts  are  not  equiva- 
lent . 


THEOREM  2.15.  Let  6t  be  an  MSMA  decision  function  for  the 


mixing  structure  M and  let  U c S^.  If  6^.  strongly  links  the 


-1, 


sensor  mixes  for  U to  nature,  and  y e h (U) , then 


E[Lt(x,5tW)  ] i ECLt(st  j(y)’MSt  j(y)')-)] 


where  x e X . , , . 

3 (y) 


Proof:  Let  x be  an  arbitrary  member  of  ^ and  let 


y = s^  . , . . The  result  then  follows  from  Definition  2.14. 
7 t j(y) 


It  should  be  noted  that  the  concept  of  linking  (strongly 


linking)  the  sensor  mixes  for  U c S to  nature  relates  to  all  the 


sensor  mixes  for  U.  However,  the  concept  of  an  MSMA  decision 
function  linking  the  sensor  mixes  for  U to  nature  really  describes 
the  behavior  of  the  loss  function  in  a neighborhood  of  the  state  of 
nature;  i.e.,  as  the  associated  variance  of  the  sensor  mix  approaches 
zero,  the  loss  function  converges  in  mean  square  to  the  loss  at  the 
state  of  nature.  This  all  takes  place  in  A. 

It  is  now  appropriate  to  demonstrate  an  important  result.  If  an 


MSMA  decision  function  links  the  sensor  mixes  for  U c S to  nature 


and  if  e,  n are  arbitrary  positive  constants,  then  there  exists  a 
-1 


sensor  mix  y e h (U)  such  that 

Pr{x|  |Lt(x,6t(x))  - Lt(st|j(Yr6t(st|j(Y)))  | > e}  < n- 
For  notational  purposes  s = and  Lt(»)  = wiH 

be  used  from  this  point.  The  above  probability  statement  implies 
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that  for  a given  precision  level  e,  it  is  possible  to  choose  a 


for  U whose  associated  loss  differs  from  the  loss 


due  to  complete  knowledge  of  the  state  of  nature  by  as  small  a value 


as  desired;  and  this  at  any  predetermined  level  of  probability 


THEOREM  2.16.  Let  M be  a mixing  structure  for  T and 


U c S . Suppose  6 is  an  MSMA  decision  function  linking  the  sensor 


mixes  for  U to  nature.  Then  given  any  e,n  > 0 there  exists  a 


Pr{x | |Lt(x)  - L(s)  | > c}  < n 

whenever  y e h-1(U)  and  J Var[z]  < t where  x e X.,  ... 

zey  J'-Yl 

Proof:  From  Definition  2.14,  for  any  choice  of  sensor  mixes 


then  L (x  ) -+  L (s)  in  mean  square.  But  if  a sequence  of  functions 


converges  in  mean  square,  then  it  converges  in  probability.  Hence 


the  result  follows 


An  interesting  insight  into  the  mathematical  structure  presented 
to  this  point  is  afforded  by  the  following  theorem  which  relates  the 


concept  of  linking  the  sensor  mixes  for  U c S to  nature  and  the 


behavior  of  the  expected  loss  function 


THEOREM  2.17.  Let  6.  be  an  MSMA  decision  function  for  the 


mixing  structure  M linking  the  sensor  mixes  for  U c S to  nature 


Let  y e h (U) . Suppose  that  the  expected  loss  function  E[L  (x) ] 


is  continuous  at  st  | j Cy)  w^ere  x e (y)  ‘ ^en  given  anY  positive 

constants  e,  n>  there  exists  a t > 0 and  a sensor  mix  v e h_1(U) 


such  that  whenever 


a)  Pr{x|  |E[L^(x)  ] - E[Lt(s)]|  >_  e}  < n 

b)  E[L  (x  ) ] -*■  E[L  (s)  ] in  probability  where  x ,n  = 1,2 


is  defined  via  Definition  2.14 


Proof 


a)  The  continuity  of  E[L  (x) ] at  s = s 


|E[Lt(x)]  - E[Lt(s)]|  < € 
whenever  II x - s ||  < t * . It  follows  that 


(x | |E[Lt(x)]  - E[Lt(s)]|  > €}  c {x | || x - s||  > x'}. 

If  Pr  is  the  probability  measure  determined  by  the  joint 


distribution  of  the  random  vector  x on  the  product  measure 


By  a straightforward  extension  of  Tchebycheff ' s Inequality 


Let  x be  such  that  x < (x*)  n-  Then  any  sensor  mix 

v e h"*(U)  such  that  £ Var[z]  < x works. 

zev 


b)  This  follows  immediately  from  part  a)  and  Definition  2.14 


It  should  be  observed  that  in  the  proof  of  part  a)  of  this 
theorem,  only  the  continuity  of  the  expected  loss  function  at  the 
state  of  nature  was  used. 

THEOREM  2.18.  Let  M be  a mixing  structure  for  T and  6^  an 
MSMA  decision  function  linking  the  sensor  mixes  for  1)  c S to 
nature.  Then  for  any  arbitrary  positive  constants  e,  n«  there 
exists  a sensor:  mix  v e h_1(U)  such  that 

Pr{x|  |G(x)  - G(s) | > e}  < n- 

Proof:  The  proof  follows  directly  from  Definition  2.14  and 

Theorem  2.16. 

Theorem  2.16  effectively  states  that  if  an  MSMA  decision 
function  links  the  sensor  mixes  for  U c St  to  nature,  then  by 
choosing  a sensor  mix  v e h ^(U)  of  sufficient  accuracy,  the  be- 
havior of  the  loss  so  determined  may  be  made  to  approach  the  behavior 
of  loss  when  the  state  of  nature  is  known  exactly  up  to  the  content 
of  the  sensor  mix.  If,  in  addition,  the  decision  function  is  consis- 
tent with  nature,  it  is  assured  that  no  loss — and  possible  advantage-- 
will  be  realized  by  choosing  a more  inclusive  sensor  mix. 

It  is  now  appropriate  to  introduce  a "cost"  concept  into  the 
overall  structure.  Let  M be  a mixing  structure  over  T.  Let  x be 
the  set  of  all  stochastic  processes  whose  components  are  in  A,  which 
are  indexed  by  T,  whose  components  have  nonnegative  support,  and  has 
the  property  that  if  (xt|t  e T}  e x»  then  j xtdt  is  always  defined 

and  is  in  A.  Any  member  of  x will  be  called  a cost  process  for  the 
mixing  structure  M.  If  T = [tQ,t  ] and  t e T,  then  the  process 


whose  component  at  t is  given  by 


<w: 


will  be  called  the  life  cycle  costing  process  over  T.  The  set  of 

all  life  cycle  costing  processes  over  T will  be  denoted  by  x'- 

DEFINITION  2.19.  Let  M be  a mixing  structure.  Let  x be  the 

★ 

set  of  all  cost  processes  over  T.  A map  c^.:D  -+  x will  be  called  a 

* 

costing  scheme  for  M.  The  pair  (M,c  ) will  be  called  a cost 
balanced  mixing  structure. 

* 

DEFINITION  2.20.  Let  (M,c  ) be  a cost  balanced  mixing  struc- 
ture and  let  y e T.  The  "cost"  of  the  sensor  mix  y at  t will  be 
defined  as 

ct(Y)  = £c*(z). 
zzy 

THEOREM  2.21.  Let  ct  be  as  in  Definition  2.20.  Then  ct  is 
a map  of  r into  A and  possesses  the  following  properties: 

a)  If  p ,v  e T and  p c v,  then  E[c^(p)]  <_  E[ct(v)]. 

b)  If  p,v  e T with  p n v = <(>,  then 

E[ct(p  u v)]  = E[ct(p)]  + E[ct(v)]. 

c)  If  p,v  e T with  p c v,  then 

E[ct(p  - v)]  = E[ct(p)]  - E[ct(v)]. 

d)  E[ct(*)]  is  a nonnegative,  nondecreasing,  real-valued  set 

function  which  vanishes  at  <j>,  and  is  finitely  additive. 

Proof:  The  proof  is  straightforward  and  is  omitted. 

* 

DEFINITION  2.22.  Let  (M,c  ) be  a cost  balanced  mixing  struc- 
ture, y z T , and  T = [tQ,t  ].  The  life  cycle  cost  process  for  the 
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sensor  mix  j will  be  defined 

ft 

c (y)  i l c (z)ds. 

ztr  \ 

THEOREM  2.23.  Let  be  as  in  Definition  2.22.  Then 

a)  is  a map  from  r A and  ECc^C*)]  is  a nonnegative, 

nondecreasing  set  function  which  vanishes  at  <p. 

b)  If  u,v  e T and  y c v,  then 

E[ct(p)]  = ECct(v)]. 

c)  If  n ,v  e T and  u n v = #,  then 

ECct(p  u v)]  < ECctGi)]  + E[ct(v)]. 

d)  If  y,v  e T and  y c v,  then 

E[ct(v  - y)]  = E[ct(v)]  - E[ctCi)]. 

Proof:  That  the  image  of  c lies  in  A follows  immediately 

from  the  finiteness  of  sensor  mixes . The  remaining  portions  of  the 
theorem  are  straightforward  and  are  omitted. 

It  seems  necessary  at  this  point  to  interrupt  the  continuity  of 
presentation  to  clarify  a few  essential  points.  In  the  structures 
presented  so  far,  one  encounters  randomness  at  three  different 
points.  There  are  the  stochastic  processes  in  f2  and  x and  the 
random  variables  in  A.  Each  of  these  probabilistic  entities  repre- 
sents random  actions;  but  A,  x may  in  a sense  be  related  to  an 
agency  external  to  the  structure  considered  and  has  some  earmarks  of 
the  strategies  of  a conscious  opponent.  The  processes  in  x are  the 
life  cycle  costing  processes  for  the  sensors  in  fi  or  the  sensor 
mixes  in  T,  and  represent  the  possibility  of  increased  cost  due  to 
accident,  effects  of  hostile  environment,  sensor  failure  due  to 


internal  causes,  etc.  The  sensors  in  ft  are  random  due  to  the  in- 
ability of  instruments  to  observe,  record,  and  transmit  information 


without  the  possibility  of  random  error. 

The  MSMA  loss  function  L^,  relating  the  various  estimates  of 
natural  states  and  admissible  plans  of  action  with  a random  "loss" 
variable  at  t,  contains  within  its  structure  much  of  the  cause/ 
effect  relationships  which  constitute  a mixing  structure.  In  a real 
instance  this  could  be  very  complex.  For  a given  t e T,  the  MSMA 
loss  function  at  t contains  an  entire  rationale  of  operation  for 
the  system,  as  well  as  the  sensitivity  of  the  system  to  fluctuations 
in  the  physical  observables.  This  loss  function  depends  onty  on  the 
action  taken  and  the  prevailing  state  of  nature,  and  not  on  the 
observed  state  of  nature  as  indicated  by  x e X.  The  sole  link 
between  an  observation  "x"  and  the  "loss"  experienced  is  through  the 
MSMA  decision  function.  It  is  very  possible  that  such  a function 
produces  a minimal  loss  based  on  an  entirely  biased  knowledge  of  the 
state  of  nature. 

The  sensitivity  of  "loss"  due  to  variations  in  the  state  of 
nature,  or  to  observational  errors  in  the  pertinent  states  of  nature 
may  arise  from  inherent  characteristics  of  the  loss  function  itself 
or  from  interactions  between  the  loss  function  and  an  MSMA  decision 
function.  However,  since  any  MSMA  decision  function  maps  X into 

A 

A^  which  has  neither  measure  nor  topological  characteristics,  only 
the  sensitivity  as  manifested  through  the  behavior  of  Lt  can  be 
studied. 


It  is  now  worthwhile  to  reexamine  the  concept  of  gain  as  related 


to  the  idea  of  sensor  mixes. 

THEOREM  2.24.  Let  M be  a mixing  structure  and  6^  be  an  MSMA 
decision  function.  Let  Gt  be  the  gain  for  x e X as  defined  in 
Definition  2.13.  If  6^  strongly  links  the  sensor  mixes  for  U c 
to  nature,  then 

a)  For  any  x e X^  ^ , E[Gt(x)]  <^E[Gt(s)]  where  y e h_1(U). 

b)  If  x,y  e X . , . and  0 < w e X.,  . is  such  that 

J lYJ  J (y) 

l w(q)[y(q)  - s(q)]2  £ w(q)[x(q)  - s(q)]2,  then 

qej(Y)  qej(Y) 

E[Gt(y)]  < E[Gt(x)]. 

c)  Let  <x  > be  any  sequence  of  members  of  X.,  ..  If  n > m 

n j(y) 


implies 


I xn  - s«  iHxm  - 


then  the  sequence  <ECG^.(xn) n>  is  a monotone  increasing 
sequence  of  real  numbers  converging  in  mean  square  to 
E[Gt(s)]. 

Proof: 

a)  It  follows  trivially  from  Theorem  2.15  a). 

b)  and  c)  follow  from  Definition  2.14. 

DEFINITION  2.25.  Let  (M,c  ) be  a cost  balanced  mixing  struc- 
ture over  T and  let  6^  be  an  MSMA  decision  function.  For  y e T, 
the  random  variable 

Ft(y)  = Gt(y)  - kct(y) 

will  be  called  the  instantaneous  figure  of  merit  for  y at  t.  If 
E[Ft(y)]  > 0,  y will  be  called  an  acceptable  sensor  mix  at  t for 
the  MSMA  decision  function  6t-  y e T is  said  to  have  greater 
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It  should  be  noted  that  in  the  above  definition  it  is  assumed 


that  G and  kc  are  expressed  in  the  same  value  units,  whatever 


these  may  be.  k is  the  constant  conversion  factor  required  to 


accomplish  this 


THEOREM  2.26.  Let  (M,c  ),  6+,  and  F be  as  in  Definition 


2.25.  Then  if  6«.  is  consistent  with  the  state  of  nature,  F :T  -+  A 


where 


defined  in  Definition  2.10  we  have  for 


0 follows  immediately  from  Definition  2.25 


Proof 


E[c  (y)]  ^ 0 by  Theorem  2.21  d)  for  all  y e T.  By  Theorem  2.12  for 


Hence  the  result  follows 


Recall  from  Theorem  2.11  that  E[G  (y)]  = E[G  (p)]  where 


y,p  e (gt)~  (U) . Hence  to  obtain  the  maximum  expected  instantaneous 


figure  of  merit  for  a subset  U c S , it  is  necessary  to  choose  a 


sensor  mix  y e T which  provides  the  necessary  information  about 


U c S with  the  minimal  expected  cost.  This  may  not  be  the  most 


feasible  course  of  action,  however,  since  the  gain  function  may  have 


a large  variance.  Thus  it  is  necessary  to  form  a tradeoff  between 


the  consistency  of  the  gain  function  and  the  cost  function.  Toward 


this  end  the  presentation  continues 


Observe  that  in  a straightforward  manner  the  definition  of 


determine  the  advantage  of  employing  a sensor  mix  y up  to  soue 
point  t e T,  it  should  follow  that  the  accumulated  gain  must  be 
balanced  against  the  cost  to  t of  the  operation.  The  following 
definition  specifies  the  sort  of  mixing  structures  for  which  such  an 
action  is  possible. 

DEFINITION  2.28.  Let  M be  a mixing  structure  ov«?r  T and  let 
(6t  | t e T}  be  a decision  scheme  for  M.  The  mixing  structure  M 
will  be  said  to  have  a summable  progression  of  losses  with  respect  to 
{6t  | t e T}  if  and  only  if  for  any  y e T,  the  process 

ibt(xt,6t(xt))  | t e T} 

is  Lebesque-Stieltjes  integrable.  In  this  case  the  scheme 

{6t  | t e T}  will  be  said  to  determine  £ summable  progression  of 

losses. 

Note  that  if  {6t  | t e T}  determines  a summable  progression  of 

* * * 

losses,  one  may  define  new  functions  L^,  G^,  and  F^  by  allowing 
the  values  of  these  functions  at  t e T to  be  the  appropriate  inte- 
grals to  t e T of  , G^,  and  F^.  The  existence  of  the  functions 

* * * 

Gj.  and  F follows  from  the  fact  that  is  a summable  pro- 

gression of  losses  and  the  fact  that  the  cost  function  is 
monotonically  nondecreasing. 

Concern  will  now  center  on  fixed  sensor  nr'xes  over  T. 

DEFINITION  2.29.  The  function  Ft  will  be  called  the 
cumulative  figure  of  merit  for  the  sensor  mix  y.  The  real  number 


EtF^fy)]  will  be  called  the 


cumulative  figure  of  merit. 


THEOREM  2.30.  The  cumulative  figure  of  merit  F for  a sensor 

* 

mix  y is  a real-valued  set  function  on  r such  that  F ($)  = 0. 
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Proof:  The  proof  is  elementary  and  is  omitted. 

Several  observations  may  be  made  at  this  time.  The  cumulative 
figure  of  merit  may  not  be  a nondecreasing  function  of  time.  This  is 
easily  seen  by  examining  the  appropriate  definition.  A sensor  mix 
y at  a fixed  t e T may  have  a larger  expected  cumulative  figure  of 
merit  than  a sensor  mix  per,  but  ^-ay  alter  drastically  at  some 
other  t e T. 

The  expected  cumulative  figure  of  merit  may  be  large,  but  the 
sensor  mix  may  not  be  desirable  due  to  large  fluctuations  or  variance 
of  the  cumulative  gain  function. 

It  is  at  this  point  that  cost  and  gain  can  be  "balanced".  By 
examining  the  totality  of  acceptable  sensor  mixes  for  M which  is 
related  to  t»r  expected  cumulative  figure  of  merit,  one  proceeds  as 
follows . 

Suppose  the  most  important  consideration  for  choosing  an  accep- 
table sensor  mix  is  the  consistency  of  the  gain.  Then  by  choosing  an 

★ 

acceptable  variance  for  the  gain  function  G , one  determines  a 
sensor  mix  of  minimal  cost  which  gives  this  result. 

However,  if  the  life  cycle  cost  is  the  essential  item  under 
consideration,  one  may  choose  a sensor  mix  that  yields  the  largest 
expected  cumulative  gain  or  the  one  with  the  most  consistency  of 
gain. 

Thirdly,  it  may  be  necessary  to  have  both  a limit  on  the  life 
cycle  cost  aspect  and  to  consider  the  consistency  of  gain.  It  is  now 
possible  to  graph  life  cycle  cost  versus  the  cumulative  consistency 
for  gain  and  thus  consider  possible  tradeoffs. 


Sufficient  structure  has  been  developed  at  this  time  to  examine 
the  Problems  I,  II,  and  III  as  defined  earlier.  Hov'ver,  the  method 
used  to  solve  these  problem  areas  depends  on  the  particular  applica- 
tion of  interest.  Certain  applied  problems  using  this  theory  are 
currently  undergoing  examination  and  investigation. 


CHAPTER  III 


AN  ILLUSTRATIVE  EXAMPLE 

To  this  point  the  existence  of  a mixing  structure  and  related 

entities  has  not  been  demonstrated.  The  purpose  of  this  section  is 

to  provide  a nontrivial  example  which  will  illustrate  the  existence 

of  such  and  will  provide  a valuable  amount  of  structural  insight. 

In  the  following  T will  be  taken  as  a nontrivial  finite  closed 

interval  of  real  numbers,  and  P will  be  a set  of  finite  cardinality 

n,  where  n is  greater  than  one.  Now,  let  {f  | p e P}  be  an 

indexed  set  of  distinct  real-valued  functions  defined  and  bounded  on 

T.  The  set  {f^(t)  | p e P}  will  be  taken  as  the  state  of  nature  at 

t,  so  that  the  set  {f^ft)  | t e T}  becomes  the  evolution  of  the 

natural  state  f over  T. 

P 

Let  (R,L,m)  be  the  Lebesque  real  measure  space,  and  let  ft 

and  A be  defined  as  in  Chapter  II.  Recall  that  ft  is  the  set  of 

all  stochastic  processes  on  (R,L,m)  with  the  property  that  if 

{ u).  I t e T}  is  in  ft,  then  there  exists  a natural  state  f whose 
t p 

evolution  is  { E (oj^ ) | t e T}.  Also  recall  that  A is  the  set  of 

all  random  variables  on  (R,L,m)  of  finite  mean  and  variance. 

The  structures  developed  via  each  oi  the  following  theorems  or 
observations  will  be  assumed  in  all  subsec uent  constructions. 


OBSERVATION  3.1.  Let  A^  be  the  set  of  real  numbers  and  A^ 
be  all  subsets  of  A^  of  cardinality  less  than  or  equal  to  that  of 

A 

P.  Then  {(At,At)  | t e T)  may  be  taken  as  an  action  family  over 

A 

T,  where  At  represents  admissible  plans  of  action  for  each  t e T. 


be  as 


A 

OBSERVATION  3.2.  Let  fl,  A,  and  {(At>At)  | t e T} 

previously  defined.  Let  X be  defined  in  context;  i.e.,  X = u Xn 

QcP  y 

A 

where  X^  = {x  | x : Q -»■  R} . Consider  the  function  d^  : X * A{  + R 
by 


dt(x’Bt} 


fM(t)  x e X,  Bt  = <f> 


M(t)  1 

L 


exp-|-  l n a (t)[b  - f (t)] 
pcP  beBt  p p 


otherwii e. 


Here  M(t)  is  a positive  real  number  and  ■[ ct^ (t)  | p e P}  is  the 
value  at  t of  a set  of  positive  real-valued  functions  {oip  | p e P) 
defined  on  T.  The  vector  {cip  | p e P}  is  a weight  function  whose 
role  is  to  assign  a relative  importance  to  the  various  states  com- 
prising the  state  of  nacure. 

Obviously  d^  is  well-defined  and  nonnegative  for  all  t e T. 

A 

Define  a map  for  each  t c T,  L : X x At  -*■  A by 

N(dt(x,$),02)  Bt  = <f> 

N(d.(x,B  ),o2)  otherwise 

l z z 

2 

where  N(K,o  ) is  a normal  random  variable  with  mean  K and  vari 

2 

ance  a . 

Clearly  the  image  of  L^  is  in  A so  that  {L^  | t e T} 

defines  a progression  of  losses  for  the  cited  structure.  Hence  L^ 

is  an  MSMA  loss  function.  It  might  also  be  noted  that 

B = {f  (t)  I p e P}  is  itself  an  admissible  plan  of  action  at  t. 
t p 1 

THEOREM  3.3.  The  function  dt  as  defined  in  the  previous 
observation  is  characterized  by 


VX’V  - 
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a)  The  image  of  lies  in  [0,M(t)]  for  all  t e T and  is 

equal  to  M at  B = <fr. 

b)  dt(x,Bt)  has  a minimum  of  0 when  action  B^  equals  the 
state  of  nature  (f^(t)  | p e P}. 

Proof : 

a)  Part  a)  is  by  definition. 

b)  When  B = {f  (t)  | p e P),  each  b in  B is  equal  to 

t p [ 

fp(t)  for  some  p e P.  Hence 

I n o (t)Cb  - f (t)]2  = l o = o. 

pcP  beB^.  p p peP 

It  follows  that  dt(x,Bt)  is  also  zero. 

COROLLARY  3.4.  The  expected  value  of  the  random  variable  L 
possesses  the  following  properties: 

a)  The  image  of  E[L  (*,*)]  lies  in  [0,M(t)]  for  all 
t in  T. 

b)  E[Lt(x,Bt)]  = 0 when  Bt  = {f  (t)  | p e P}. 

Proof:  This  is  an  immediate  consequence  of  Theorem  3.3  and  the 

definition  of  L^O,*)* 

THEOREM  3.5.  The  sextuple 

C{f  | p t P},  {(At,At)  | t e TJ,  Q,  X,  {Lt  | t e T},  A] 
forms  a nontrivial  mixing  structure. 

Proof:  The  proof  follows  directly  from  Observations  3.1  and 

3.2. 

THE0RE4  3.6.  Any  map  B : R ->  R determines  a set  of  MSMA 
decision  functions  for  the  mixing  structure  M in  the  previous 
theorem. 
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Proof:  Let  6 : R -*■  R be  an  arbitrary  function.  Let 


For  each  x e X there  exists  a subset  Q c P such  that 


x e X-.  Define 


Certainly  6 (x)  defines  a subset  of  A 


is  an  MSMA  decision  function.  Since 


was  chosen 


arbitrarily,  the  result  follows 


COROLLARY  3.7.  Let  J,  K be  any  two  natural  numbers.  Then  any 


transformation  B from  Euclidean  J-space  E to  Euclidean  K-space 


E determines  a set  of  MSMA  decision  functions  for  the  mixing  struc 


Proof:  Let  B : E -*■  E be  an  arbitrary  transformation.  Let 


0 and  x e X.  Thus  there  exists  a subset  O c P such  that 


is  the  projection  from  E onto  its  first  coordinate 


where  r 


The  fact  that  6 (x)  is  an  MSMA  decision  function  follows  from 


Theorem  3.6 


It  should  be  noted  that  each  transformation 


determines  many  MSMA  decisions  for  the  cited  mixing  structure.  For 


example,  instead  of  projecting  E onto  its  first  coordinate,  one 


may  use  any  other  coordinate  projection 


THEOREM  3.8.  For  each  subset  U c S.  , where  S„.  is  the  state 


of  nature  at  t,  define 


U.  Then  6.  is  an  MSMA  decision 


function  consistent  with  the  state  of  nature  at  t 


Proof:  Clearly  fi^fU)  is  an  MSMA  decision  function  for  each 

U c S . To  show  that  this  decision  function  is  consistent  with  the 
state  of  nature,  it  suffices  to  examine  the  function  dt  as  defined 
in  Observation  3.2. 

Case  I:  If  U = <f>,  then  <$t(U)  = <p  and  dt(x,(|>)  = M(t).  And 

all  three  parts  of  Definition  2.6  are  clearly  satisfied. 

Case  II:  If  U ? <J>,  then  for  each  p e P such  that 

f (t)  e U,  b = f^(t).  Hence 
P ? 

n a (t) [b  - f (t)]2  = 0. 
be«t(U)  P P 

Let  U c V,  then  f^(t)  e U c V.  For  each  p e P such  that 
fp(t)  e V - U, 

n a ft) [b  - f (t)]2  t 0. 
be6t(U)  P P 

By  letting  Q = {p  e P | f ft)  t V)  and  Q,  = {p  e P | f (t)  i U), 

it  follows  that 

E[Lt(V,6t(V))J  = dt(V,5t(V)) 

= M(t)[l  - exp{-  l n a (t)[b  - f (t)]2)] 
peP  be«t(V)  p p 

= M(t)[l  - exp{-  l n aft)[b  - f (t)]2}] 

PeQj  be6t(V)  P P 

< M(t) [1  - exp{-  l n an(t)[b  - f ft)]2}] 

peQ2  befit(U)  P P 

- dt(U,«t(U))  = E[Lt(U,6t(U))]. 

Thus  part  a)  of  Definition  2.6  is  satisfied.  Part  b)  follows  from 
the  fact  that  dt(U,6t(U))  = dt(V,6t(U))  and  the  proof  of  part  a) 
above.  Part  c)  is  trivial.  Thus  6t(*)  is  an  MSMA  decision  function 
consistent  with  the  state  of  nature. 
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Note:  Let  f be  a natural  state.  Recall  that  the  set  of 

P 

sensors  for  f is  {u  e fl  | id  e (h  ) (f^) } where  h represents 

. * 

the  following  relationship.  Let  w = | t e T}.  Then  h (<d)  = f^ 

where  f is  the  state  variable  whose  evolution  is  { H C D I t e T}. 
P t 

OBSERVATION  3.9.  Let  y e T be  a sensor  mix  and  x e Xj (y) ’ 
Define  6^(x)  = x.  Observe  that  6t(x)  is  an  MSMA  decision  function 
for  M,  and  if  all  the  sensors  in  y have  zero  variance,  then 
6t(x)  = for  an  appropriate  U c where  6^(1/)  is  defined 

via  Theorem  3.8. 

THEOREM  3.10.  The  MSMA  decision  function  5tO)  defined  in 
Observation  3.9  links  the  sensor  mixes  for  U c s to  nature. 

Proof:  For  <f>  = U c S^,  the  theorem  is  vacuously  true.  Let 

$ ? U c S^  and  {vn  | n = 1,2,*»»}  a sequence  of  sensor  mixes  in 

h - 1 (U)  such  that  £ VarCzn]  -*■  0.  Let  {xn  | n = 1,2,***>  be  any 

z e\> 
n n 

sequence  of  realizations  x for  v . From  Theorem  3.3, 

n n 


dt(s,6t(s))  = 0.  Hence 


R(x_ 


1 

r 

? 

■ 

exp 

2ira 

j 

-00 

- exp 

(y-dt(s. 

2a 

1 

>00 

2 

exp 

2tt  a 

-00 

(y-dt(xn,6t(xn))‘ 


2a 


J J 


dy 


(y-dt(xn,6tCxn))' 


2a 


e;.p 


2a 


dy. 


which  is  integrable  since  the  square  of  an  integrable  function  is 
integrable.  Thus  R(xn)  is  a continuous  function  of  xr.  Since 
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lim  dt^xn’^t(xn^  = °» 
n-x» 

lim  Rfx  ) = 0,  i.e.,  L (x  ) converges  to  L (s)  in  mean  square. 
n-x»  n z 

Thus  6^  is  an  MSMA  decision  function  linking  the  sensor  mixes  f r 
U to  nature.  This  holds  for  all  subsets  U c and  thus  the 
theorem  follows. 


OBSERVATION  3.11.  Let  B = ffp(t)  | p e P}.  This  is  an  optimal 
plan  of  action  for  M in  the  sense  that  it  results  in  a unique 
absolute  minimal  value  for  the  expected  value  of  the  MSMA  loss 
function  (•,•)• 

Proof:  E[L^.  (x,  B)  ] = dt(x,B).  Clearly  d^fx.B)  is  bounded 

below  by  zero.  Also  for  B = {f  ft)  | p e P},  d (x,B)  = 0.  Thus 

r ^ 

only  the  uniqueness  of  B needs  verification.  dt(x,B)  = 0 implies 
that 


exp 


- I n «D(t)[b  - f (t)]2i  = i. 

( peP  beB  p P 


But  expf-y)  - 1 implies  that  y = 0.  Hence 

l n a (t) [b  - f (t)]2  = 0. 

pcP  beB  p p 

. 2 
Since  <*p(t)  > 0 and  [b  - fpft)]  >_  0,  each  term  of  the  summation 

must  be  zero.  This  in  turn  implies  [b  - fpft)]  = 0 for  each 

beB.  This  can  only  occur  if  b = f ft)  for  some  p e P.  Since  we 

are  summing  over  P,  this  must  be  true  for  all  p e P.  Therefore, 

B = ffpft)  | p e P)  is  unique. 

To  show  that  the  concepts  of  an  MSMA  decision  function  consis- 
tent with  the  state  of  nature  and  of  an  MSMA  decision  function 
linking  the  sensor  mixes  for  U c_  S^  to  nature  are  not  equivalent,  a 
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J . J -WIBpiipjll'  ,1.  .... 
■ 


slight  modification  of  the  MSMA  loss  function  proves  satisfactory. 
OBSERVATION  3.12.  Consider 


where  M(t)  and  c*p(t)  are  defined  in  Observation  3.2.  Let 
Lt(x,Bj  and  6t(x)  be  as  previously  defined  in  Observations  3.2  and 
3.9  respectively.  To  show  6t(*)  is  an  MSMA  decision  function  con- 
sistent with  the  state  of  nature,  it  suffices  to  use  a proof  identi- 
cal to  that  of  Theorem  3.8.  Since  d (•»•)  has  a jump  discontinuity 
at  the  state  of  nature, 

lim  ||  dt  Cxn,6t  (xn))  - d^s^Js))  J > 0 

n-*» 

for  any  sequence  {xn  | n * 1,2,***}  in  X which  converges  to  s. 


Thus 


lim  ; 

n-»*>  2ira' 


r J 

p- 

exp 

(y-dt  (V6t(xn)r 


2a 


- exp 


Cy-dt(s,6t(s))' 


2a' 


dy  > 0 


and  6^(0  does  not  link  (strongly  link)  the  sensor  mixes  for 
U c to  nature  for  any  nonempty  U c S{. 

OBSERVATION  3.13.  Consider 

fM(t)  B = * 


dt(x,B)  = 


M(t) 


+ exp|- 


l R a (t)[b  - f (t)3 
peP  beB  p p 


I 


otherwise 
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dt(x,B)  = ■ 

M(t)  + 1 
-1 

B = d> 

x = s 

' 

M(t) fl  - exp- 

- 1 n aD(t)[b  - f (t)]^V 

otherwise 

l L 

[ p£P  bep  P P J. 

m 


where  M(t)  and  o^ft)  are  as  previously  defined.  Let  Lt(x,B) 
and  6t(x)  be  as  previously  defined  in  Observations  3.2  and  3.9 
respectively.  By  mimicking  the  proof  to  Theorem  3.10,  it  is  easy  to 
demonstrate  that  6^(0  is  an  MSMA  decision  function  linking  the 
sensor  mixes  for  each  nonempty  subset  U c St  to  nature.  That 
6t(*)  is  an  MSMA  decision  function  not  consistent  with  the  state  of 
nature  follows  by  noting  if  U c V,  U,V  c S , then 
ECLt(U,6t(U))]  > E[Lt(V,6t(V))]. 

This  contradicts  part  b)  of  Definition  2.6. 

OBSERVATION  3.14.  Let  d^Cx.B),  L^fx.B),  and  6t(x)  be  as 
defined  in  Observation  3.13.  Then  6tO)  is  an  MSMA  decision 
function  which  does  not  strongly  link  the  sensor  mixes  for  U £ St 
to  nature  for  any  nonempty  U c St.  This  follows  by  noting  that  for 
all  nonempty  sensor  mixes  y e V 

dt(x,6t(x))  = ECLt(x,6t(x))]  > ECLt(s^t(s))3 
= dt(s,«t(s)) 

for  x f s,  x e ^ j . This  contradicts  part  b)  of  Theorem  2.15. 
Thus  the  example  contained  in  Observation  3.12  demonstrates  that  the 
concept  of  linking  y to  nature  does  not  imply  the  concept  of 
strongly  linking  to  nature. 

This  section  thus  provides  a nontrivial  example  of  a mixing 
structure  and  related  entities.  It  also  demonstrates  the  fact  that 
the  concepts  of  an  MSMA  decision  function  being  consistent  with  the 
state  of  nature  and  linking  the  sensor  mixes  for  U c St  to  nature 
are  not  equivalent. 

To  highlight  this  example  and  some  of  the  structure  developed 
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herein,  a simplified  and  somewhat  naive  version  of  an  artillery 
problem  may  be  used.  This  problem  is  concerned  with  the  ability  to 
hit  a certain  target  with  an  artillery  projectile.  It  is  assumed 
that  the  only  contribution  to  the  "missing"  of  the  target  is  due  to  a 
lack  of  knowledge  concerning  the  meteorological  parameters  of  atmos- 
pheric temperature,  wind  speed,  wind  direction,  and  atmospheric 
pressure.  Each  of  these  parameters  is  further  assumed  to  be  charac- 
terized by  a single  real  number,  i.e.,  the  "ballistic  number".  The 
state  of  nature  St  then  consists  of  these  four  meteorological 
parameters . 

Since  the  artillery  projectile  is  unguided,  the  launcher  setting 
required  to  hit  the  target  must  include  compensation  for  the  four 
meteorological  parameters  of  interest.  To  accomplish  this,  the 
artillery  officer  in  charge  must  decide  what  values  should  be  used 
for  these  parameters.  This  will  constitute  his  action  set.  These 
values  are  then  utilized  as  input  to  some  undefined  black  box  which 
converts  them  into  launcher  settings.  The  projectile  is  then  fired 
on  these  settings. 

For  this  problem,  the  set  of  actions  at  t can  be  taken  as  the 
real  line  and  the  admissible  actions  at  t the  subsets  of  the  real 
line  of  cardinality  less  than  or  equal  to  four.  This  coincides  with 
the  family  of  actions  as  defined  in  Observation  3.1. 

To  obtain  estimates  about  the  state  of  nature,  various  meteoro- 
logical sensors  are  used.  These  range  from  the  very  simple,  such  as 
a thermometer,  to  the  very  sophisticated,  such  as  radars  and 
satellites.  Each  of  these  sensors  has  its  own  probabilistic 
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characteristics.  Let  0,  A,  and  {(At>At)  | t e T}  be  as  pre- 
viously defined  and  let  X be  defined  in  context. 

Let  the  loss  function  at  t,  L^,  be  an  assessment  of  the  "miss 
distance"  for  the  projectile.  It  is  intuitive  that  the  four  meteoro- 
logical parameters  contribute  unequally  to  the  miss  distance,  and 
that  the  expected  loss  due  to  lack  of  knowledge  of  the  state  of 
nature  should  be  maximal.  The  loss  function  as  defined  in  Observa- 
tion 3.2  has  these  properties.  As  increased  information  concerning 
the  state  of  nature  is  obtained,  the  expected  loss  should  approach 
zero,  which  would  be  the  case  when  complete  knowledge  of  the  state  of 
nature  is  known.  Thus  this  loss  function  is  applicable  to  the  stated 
problem. 

The  sextuple  C{f  | p e P},  { (A^.A^)  | t e T},  0,  X, 

{Lt  | t e T},  A]  thus  forms  a mixing  structure  as  indicated  in 
Theorem  3.5. 


When  the  admissible  action  is  equal  to  the  state  of  nature,  the 
expected  loss  is  zero;  and  if  the  chosen  action  is  the  standard  plan 
of  action,  the  expected  loss  is  maximal  M(t) . 


Let  T be  the  set  of  all  sensor  mixes,  y e r,  and  x e X.^. 

By  letting  6^(x)  = x,  one  obtains  an  MSMA  decision  function  for  this 
problem.  Since  this  is  a mixing  structure  without  lag,  it  is  easy  to 


verify  that  6 ^ ) is  an  MSMA  decision  function  which  is  both  con- 
sistent with  the  state  of  nature  and  links  every  sensor  mix  for 


U c S{  to  nature.  In  fact,  if  the  admissible  action  corresponds  to 
a sensor  mix  with  zero  variance,  a unique  absolute  minimal  value  for 


the  MSMA  loss  function  is  obtained  as  in  Observation  3.11. 
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Thus  it  may  be  seen  that  this  simplified  version  of  the 
artillery  problem  demonstrates  the  applicability  of  both  this  illus- 
trative example  and  the  theory  as  developed  in  Chapter  II.  In  fact, 
it  is  not  difficult  to  visualize  a wide  variety  of  other  practical 
applications. 


CHAPTER  IV 


OPEN  PROBLEMS 

In  this  chapter  a discussion  of  selected  open  problems  is 
presented. 

It  should  be  observed  that  at  no  time  in  the  mathematical 
development  presented  previously  was  there  any  discussion  of  methods 
of  derivation  for  a decision  function  yielding  a feasible  course  of 
action.  This  was  in  the  large  intentional,  since  the  choice  of  a 
decision  function  may  well  depend  on  the  particular  application  of 
interest;  i.e.,  on  the  form  of  the  MSMA  loss  function  itself.  Hence 
a family  of  open  problems  arise  in  the  selection  of  decision  func- 
tions leading  to  those  feasible  courses  of  action  particular  to  a 
given  loss  function.  Possible  approaches  involve  the  use  of  dynamic 
programming  or  sequential  decision  theory.  (See  [1]  or  [15].) 

The  relation  of  this  structure  and  other  known  theories  may  re 
more  comprehensively  investigated  with  similarities  and  differences 
precisely  delineated.  Pertinent  theories  include  optimal  stopping 
[5],  sampling  theory  [2],  various  economic  theories  such  as  organi- 
zation theory  [12],  team  decision  theory  [16],  sequential  decision 
theory  [15],  differential  games  [6]  and  [8-10],  information  theory 
[18],  etc. 

In  this  presentation,  only  mixing  structures  without  lag  are 
considered.  This  implies  an  instantaneous  occurrence  for  the 
following:  observations  made  by  sensors  for  the  subset  of  the  state 
of  nature,  a choice  of  an  MSMA  decision  function  based  on  these 
observations,  and  leading  to  the  initialization  of  an  admissible 


plan  of  action,  and  the  realization  of  the  loss  function  based  on 
this  plan  of  action. 

In  physical  situations,  this  assumption  is  often  unrealistic  as 
there  usually  exists  some  delay  between  these  occurrences.  This 
leads  to  certain  questions  as  yet  unanswered. 

In  the  following,  a mixing  structure  with  lag  will  be  intro- 
duced, and  certain  problem  areas  associated  with  this  concept  will  be 
identified. 

Let  observations  concerning  the  state  of  nature  be  taken  at  time 
t;  but  the  plan  of  action  initiated  at  time  t + x be  based  on  this 
"lagged"  information.  This  may  result  in  an  increase  of  instantane- 
ous loss  at  t + t . Suppose  now  that  an  MSMA  decision  function  6 
is  chosen  at  time  t,  but  a plan  of  action  cannot  be  initiated  until 
time  t + x,  which  results  in  an  instantaneous  loss  Lt+^(x,6t(x)) 
at  t + t.  It  may  be  seen  that  this  loss  function  produces  a result 
identical  to  the  loss  associated  with  a different  MSMA  decision 
function  chosen  at  time  t + x,  and  an  instantaneous  plan  of  action 
initiated  at  that  time.  In  both  cases  the  MSMA  decision  function  may 
be  considered  to  have  a lag  of  x. 

It  can  be  seen  that  the  set  of  decision  functions  leading  to  a 
feasible  or  an  optimal  plan  of  action  may  vary  from  those  which  now 
arise  in  the  problems  considered  in  the  main  text.  Marschak  and 
Radner  [12]  have  studied  such  problems  for  special  cases  relating  to 
organizational  theory.  General  solutions  to  this  problem  do  not 
exist  at  present. 

Other  problem  areas  for  the  mixing  structure  with  and  without 


j 


48 


lag  are  as  follows.  Suppose  that  values  of  the  MSMA  loss  function  at 
t + t are  correlated  to  those  at  t.  One  immediate  pro  is  the 
choice  of  a decision  scheme  which  takes  this  behavior  into  account. 
Suppose  further  that  the  plan  of  action  at  t may  be  influenced  by 
prior  observations  and/or  prior  losses.  By  placing  appropriate 
assumptions  on  such  relationships,  the  three  general  problem  areas 
addressed  in  the  text  are  altered  in  context  to  new  problems.  Many 
applications  require  such  considerations. 

In  military  applications,  one  must  face  a conscious  opponent. 
This  opponent  may  also  be  sensing  information  concerning  the  state  of 
nature.  A natural  question  arises  as  to  how  this  affects  appropriate 
strategy.  Thus  for  varying  types  of  military  applications,  the 
structure  is  changeable,  and  new  problems  arise. 

The  partial  inclusion  of  the  attributes  derivable  from  a 
conscious  opponent  should  be  reflected  in  the  loss  function. 

Knowledge  of  the  natural  state  may  give  rise  to  advantage.  The 
opponent  in  turn  may  attempt  to  counteract  this  advantage.  Both  the 
loss  and  cost  functions  could  be  altered  by  such  an  attempt.  Such 
actions  will  be  reflected  in  the  progression  of  losses,  and  should 
be  investigated. 

The  merit  of  cost  and  operational  effectiveness  studies  in  the 
design  of  military  systems  is  well  established,  but  often  involves 
intangibles,  and  complicated  measures  of  effectiveness.  For  non- 
military applications  both  cost  and  effectiveness  are  expressed  in  a 
monetary  standard.  Although  the  structures  here  presented  were 
designed  for  military  applications,  any  physical  system  in  which 
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actions  are  based  on  analyses  of  observations  concerning  some  state 
of  nature  may  be  addressed  in  a similar  fashion. 
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